Beyond visual integration: sensitivity of the temporal-parietal junction for objects, places, and faces.

One important role of the TPJ is the contribution to perception of the global gist in hierarchically organized stimuli where individual elements create a global visual percept. However, the link between clinical findings in simultanagnosia and neuroimaging in healthy subjects is missing for real-world global stimuli, like visual scenes. It is well-known that hierarchical, global stimuli activate TPJ regions and that simultanagnosia patients show deficits during the recognition of hierarchical stimuli and real-world visual scenes. However, the role of the TPJ in real-world scene processing is entirely unexplored. In the present study, we first localized TPJ regions significantly responding to the global gist of hierarchical stimuli and then investigated the responses to visual scenes, as well as single objects and faces as control stimuli. All three stimulus classes evoked significantly positive univariate responses in the previously localized TPJ regions. In a multivariate analysis, we were able to demonstrate that voxel patterns of the TPJ were classified significantly above chance level for all three stimulus classes. These results demonstrate a significant involvement of the TPJ in processing of complex visual stimuli that is not restricted to visual scenes and that the TPJ is sensitive to different classes of visual stimuli with a specific signature of neuronal activations.

Common structure of saccades and microsaccades in visual perception.

We obtain large amounts of external information through our eyes, a process often considered analogous to picture mapping onto a camera lens. However, our eyes are never as still as a camera lens, with saccades occurring between fixations and microsaccades occurring within a fixation. Although saccades are agreed to be functional for information sampling in visual perception, it remains unknown if microsaccades have a similar function when eye movement is restricted. Here, we demonstrated that saccades and microsaccades share common spatiotemporal structures in viewing visual objects. Twenty-seven adults viewed faces and houses in free-viewing and fixation-controlled conditions. Both saccades and microsaccades showed distinctive spatiotemporal patterns between face and house viewing that could be discriminated by pattern classifications. The classifications based on saccades and microsaccades could also be mutually generalized. Importantly, individuals who showed more distinctive saccadic patterns between faces and houses also showed more distinctive microsaccadic patterns. Moreover, saccades and microsaccades showed a higher structure similarity for face viewing than house viewing and a common orienting preference for the eye region over the mouth region. These findings suggested a common oculomotor program that is used to optimize information sampling during visual object perception.

Fractal Fluency: Processing of Fractal Stimuli Across Sight, Sound, and Touch.

People are continually exposed to the rich complexity generated by the repetition of fractal patterns at different size scales. Fractals are prevalent in natural scenery and also in patterns generated by artists and mathematicians. In this chapter, we will investigate the powerful significance of fractals for the human senses. In particular, we propose that fractals with mid-range complexity play a unique role in our visual experiences because the visual system has adapted to these prevalent natural patterns. This adaptation is evident at multiple stages of the visual system, ranging from data acquisition by the eye to processing of this data in the higher visual areas of the brain. Based on these results, we will discuss a fluency model in which the visual system processes mid-complexity fractals with relative ease. This fluency optimizes the observer's capabilities (such as enhanced attention and pattern recognition) and generates an aesthetic experience accompanied by a reduction in the observer's physiological stress levels. In addition to reviewing people's responses to viewing fractals, we will compare these responses to recent research focused on fractal sounds and fractal surface textures. We will extend our fractal fluency model to allow for stimuli across multiple senses.

Semantic facilitation in blocked picture categorization: Some data and considerations regarding task selection.

Semantic context effects in picture naming and categorization tasks are central to the development and evaluation of current models of word production. When pictures are named in a semantically blocked context, response latencies are delayed. Belke (2013) found that when the naming task was replaced with a semantic categorization task (natural vs. man-made), response latencies were facilitated. From this pattern, she concluded that semantic interference in blocked picture naming has its locus at the lexical level but its origin at the preceding semantic level. However, other studies using the blocking procedure have failed to find facilitation in semantic categorization tasks (Damian et al., 2001; Riley et al., 2015), calling this conclusion into question. In three blocked picture naming and categorization experiments, we investigated different variables that might account for the discrepant results in semantic categorization. We used different semantic categorization tasks, different response modalities, different response set sizes, and different blocking procedures. Semantic facilitation was reliably found in naturalness categorization, but there was no semantic effect in natural size categorization. We discuss the implications of these findings for appropriate task selection. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

When does perceptual organization happen?

Reflectional (mirror) symmetry is an important visual cue for perceptual organization. The brain processes symmetry rapidly and efficiently. Previous work suggests that symmetry activates the extrastriate cortex and generates an event related potential (ERP) called the Sustained Posterior Negativity (SPN). It has been claimed that no tasks completely block symmetry processing and abolish the SPN. We tested the limits of this claim with a series of eight new Electroencephalography (EEG) experiments (344 participants in total). All experiments used the same symmetrical or asymmetrical dot patterns. When participants attended to regularity in Experiment 1, there was a substantial SPN (Mean amplitude = -2.423 µV). The SPN was reduced, but not abolished, when participants discriminated dot luminance in Experiments 2 and 3 (-.835 and -1.410 µV) or the aspect ratio of a superimposed cross in Experiments 4 and 5 (-.722 and -.601 µV). The SPN also survived when the background pattern was potentially disruptive to the primary task in Experiment 6 (-1.358 µV) and when participants classified negative superimposed words in Experiment 7 (-.510 µV). Finally, the SPN remained when participants attended to the orientation of a diagonal line in Experiment 8 (-.589 µV). While task manipulations can turn down the extrastriate symmetry activation, they cannot render the system completely unresponsive. Permanent readiness to detect reflectional symmetry at the centre of the visual field could be an evolved adaptation.

The brain does not process horizontal reflection when attending to vertical reflection, and vice versa.

Previous work has found that feature attention can modulate electrophysiological responses to visual symmetry. In the current study, participants observed spatially overlapping clouds of black and white dots. They discriminated vertical symmetry from asymmetry in the target dots (e.g., black or white) and ignored the regularity of the distractor dots (e.g., white or black). We measured an electroencephalography component called the sustained posterior negativity (SPN), which is known to be generated by visual symmetry. There were five conditions with different combinations of target and distractor regularity. As well as replicating previous results, we found that an orthogonal axes of reflection in the distractor dots had no effect on SPN amplitude. We conclude that the visual system can processes reflectional symmetry in independent axis-orientation specific channels.

Effect of eccentric fixation on the steady-state pattern electroretinogram.

PURPOSE: The steady-state pattern electroretinogram (ssPERG) is used to assess retinal ganglion cell function in a variety of research contexts and diagnostic applications. In certain groups of patients or study participants, stable central fixation of the stimulus is not guaranteed. The present study aimed at assessing the effects of misfixation on the ssPERG response to checkerboard reversal stimuli. METHODS: Using two check sizes (0.8° and 15°), we compared ssPERG responses for several amounts of fixation deviation, ranging from 0° to 19° horizontally and from 0° to 14° diagonally. The stimulus area extended to 15° eccentricity, stimulus reversal rate was 15/s. RESULTS: Up to around 7° eccentricity, there was no sizable effect of fixation deviation under most conditions. Effects were somewhat larger for nasal than for temporal deviation, in particular for small checks. Diagonal deviation was associated with a response to luminance onset/offset at 7.5 Hz (subharmonic of the reversal rate), most prominently when the interior of a large check was fixated. CONCLUSION: Generally, moderate inaccuracies of fixation do not have a sizable effect on ssPERG amplitude. However, with large checks, the luminance response has to be considered.

What drives the automatic retrieval of real-world object size knowledge?

Real-world object size is a behaviorally relevant object property that is automatically retrieved when viewing object images: participants are faster to indicate the bigger of two object images when this object is also bigger in the real world. What drives this size Stroop effect? One possibility is that it reflects the automatic retrieval of real-world size after objects are recognized at the basic level (e.g., recognizing an object as a plane activates large real-world size). An alternative possibility is that the size Stroop effect is driven by automatic associations between low-/mid-level visual features (e.g., rectilinearity) and real-world size, bypassing object recognition. Here, we tested both accounts. In Experiment 1, objects were displayed upright and inverted, slowing down recognition while equating visual features. Inversion strongly reduced the Stroop effect, indicating that object recognition contributed to the Stroop effect. Independently of inversion, however, trial-wise differences in rectilinearity also contributed to the Stroop effect. In Experiment 2, the Stroop effect was compared between manmade objects (for which rectilinearity was associated with size) and animals (no association between rectilinearity and size). The Stroop effect was larger for animals than for manmade objects, indicating that rectilinear feature differences were not necessary for the Stroop effect. Finally, in Experiment 3, unrecognizable "texform" objects that maintained size-related visual feature differences were displayed upright and inverted. Results revealed a small Stroop effect for both upright and inverted conditions. Altogether, these results indicate that the size Stroop effect partly follows object recognition with an additional contribution from visual feature associations. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Predicting Cued and Oddball Visual Search Performance from fMRI, MEG, and DNN Neural Representational Similarity.

Capacity limitations in visual tasks can be observed when the number of task-related objects increases. An influential idea is that such capacity limitations are determined by competition at the neural level: two objects that are encoded by shared neural populations interfere more in behavior (e.g., visual search) than two objects encoded by separate neural populations. However, the neural representational similarity of objects varies across brain regions and across time, raising the questions of where and when competition determines task performance. Furthermore, it is unclear whether the association between neural representational similarity and task performance is common or unique across tasks. Here, we used neural representational similarity derived from fMRI, MEG, and a deep neural network (DNN) to predict performance on two visual search tasks involving the same objects and requiring the same responses but differing in instructions: cued visual search and oddball visual search. Separate groups of human participants (both sexes) viewed the individual objects in neuroimaging experiments to establish the neural representational similarity between those objects. Results showed that performance on both search tasks could be predicted by neural representational similarity throughout the visual system (fMRI), from 80 ms after onset (MEG), and in all DNN layers. Stepwise regression analysis, however, revealed task-specific associations, with unique variability in oddball search performance predicted by early/posterior neural similarity and unique variability in cued search task performance predicted by late/anterior neural similarity. These results reveal that capacity limitations in superficially similar visual search tasks may reflect competition at different stages of visual processing.

The odd one out - Orthographic oddball processing in children with poor versus typical reading skills in a fast periodic visual stimulation EEG paradigm.

The specialization of left ventral occipitotemporal brain regions to automatically process word forms develops with reading acquisition and is diminished in children with poor reading skills (PR). Using a fast periodic visual oddball stimulation (FPVS) design during electroencephalography (EEG), we examined the level of sensitivity and familiarity to word form processing in ninety-two children in 2nd and 3rd grade with varying reading skills (n = 35 for PR, n = 40 for typical reading skills; TR). To test children's level of "sensitivity", false font (FF) and consonant string (CS) oddballs were embedded in base presentations of word (W) stimuli. "Familiarity" was examined by presenting letter string oddballs with increasing familiarity (CS, pseudoword - PW, W) in FF base stimuli. Overall, our results revealed stronger left-hemispheric coarse sensitivity effects ("FF in W" > "CS in W") in TR than in PR in both topographic and oddball frequency analyses. Further, children distinguished between orthographically legal and illegal ("W/PW in FF" > "CS in FF") but not yet between lexical and non-lexical ("W in FF" vs "PW in FF") word forms. Although both TR and PR exhibit visual sensitivity and can distinguish between orthographically legal and illegal letter strings, they still struggle with nuanced lexical distinctions. Moreover, the strength of sensitivity is linked to reading proficiency. Our work adds to established knowledge in the field to characterize the relationship between print tuning and reading skills and suggests differences in the developmental progress to automatically process word forms.

Neural correlates of impaired learning and recognition of novel faces in mild cognitive impairment.

OBJECTIVE: Face memory impairment significantly affects social interactions and daily functioning in individuals with mild cognitive impairment (MCI). While deficits in recognizing familiar faces among individuals with MCI have been reported, their ability to learn and recognize unfamiliar faces remains unclear. This study examined the behavioral performance and event-related potentials (ERPs) of unfamiliar face memorization and recognition in MCI. METHODS: Fifteen individuals with MCI and 15 healthy controls learned and recognized 90 unfamiliar neutral faces. Their performance accuracy and cortical ERPs were compared between the two groups across the learning and recognition phases. RESULTS: Individuals with MCI had lower accuracy in identifying newly learned faces than healthy controls. Moreover, individuals with MCI had reduced occipitotemporal N170 and central vertex positive potential responses during both the learning and recognition phases, suggesting impaired initial face processing and attentional resources allocation. Also, individuals with MCI had reduced central N200 and frontal P300 responses during the recognition phase, suggesting impaired later-stage face recognition and attention engagement. CONCLUSION: These findings provide neurobehavioral evidence for impaired learning and recognition of unfamiliar faces in individuals with MCI. SIGNIFICANCE: Individuals with MCI may have face memory deficits in both early-stage face processing and later-stage recognition .

Characterizing the discriminability of visual categorical information in strongly connected voxels.

Functional brain responses are strongly influenced by connectivity. Recently, we demonstrated a major example of this: category discriminability within occipitotemporal cortex (OTC) is enhanced for voxel sets that share strong functional connectivity to distal brain areas, relative to those that share lesser connectivity. That is, within OTC regions, sets of 'most-connected' voxels show improved multivoxel pattern discriminability for tool-, face-, and place stimuli relative to voxels with weaker connectivity to the wider brain. However, understanding whether these effects generalize to other domains (e.g. body perception network), and across different levels of the visual processing streams (e.g. dorsal as well as ventral stream areas) is an important extension of this work. Here, we show that this so-called connectivity-guided decoding (CGD) effect broadly generalizes across a wide range of categories (tools, faces, bodies, hands, places). This effect is robust across dorsal stream areas, but less consistent in earlier ventral stream areas. In the latter regions, category discriminability is generally very high, suggesting that extraction of category-relevant visual properties is less reliant on connectivity to downstream areas. Further, CGD effects are primarily expressed in a category-specific manner: For example, within the network of tool regions, discriminability of tool information is greater than non-tool information. The connectivity-guided decoding approach shown here provides a novel demonstration of the crucial relationship between wider brain connectivity and complex local-level functional responses at different levels of the visual processing streams. Further, this approach generates testable new hypotheses about the relationships between connectivity and local selectivity.

Overlapping representations of observed actions and action-related features.

The lateral occipitotemporal cortex (LOTC) has been shown to capture the representational structure of a smaller range of actions. In the current study, we carried out an fMRI experiment in which we presented human participants with images depicting 100 different actions and used representational similarity analysis (RSA) to determine which brain regions capture the semantic action space established using judgments of action similarity. Moreover, to determine the contribution of a wide range of action-related features to the neural representation of the semantic action space we constructed an action feature model on the basis of ratings of 44 different features. We found that the semantic action space model and the action feature model are best captured by overlapping activation patterns in bilateral LOTC and ventral occipitotemporal cortex (VOTC). An RSA on eight dimensions resulting from principal component analysis carried out on the action feature model revealed partly overlapping representations within bilateral LOTC, VOTC, and the parietal lobe. Our results suggest spatially overlapping representations of the semantic action space of a wide range of actions and the corresponding action-related features. Together, our results add to our understanding of the kind of representations along the LOTC that support action understanding.

Parafoveal vision reveals qualitative differences between fusiform face area and parahippocampal place area.

The center-periphery visual field axis guides early visual system organization with enhanced resources devoted to central vision leading to reduced peripheral performance relative to that of central vision (i.e., behavioral eccentricity effect) for many visual functions. The center-periphery organization extends to high-order visual cortex where, for example, the well-studied face-sensitive fusiform face area (FFA) shows sensitivity to central vision and the place-sensitive parahippocampal place area (PPA) shows sensitivity to peripheral vision. As we have recently found that face perception is more sensitive to eccentricity than place perception, here we examined whether these behavioral findings reflect differences in FFA's and PPA's sensitivities to eccentricity. We assumed FFA would show higher sensitivity to eccentricity than PPA would, but that both regions' modulation by eccentricity would be invariant to the viewed category. We parametrically investigated (fMRI, n = 32) how FFA's and PPA's activations are modulated by eccentricity (≤8°) and category (upright/inverted faces/houses) while keeping stimulus size constant. As expected, FFA showed an overall higher sensitivity to eccentricity than PPA. However, both regions' activation modulations by eccentricity were dependent on the viewed category. In FFA, a reduction of activation with growing eccentricity ("BOLD eccentricity effect") was found (with different amplitudes) for all categories. In PPA however, qualitatively different BOLD eccentricity effect modulations were found (e.g., at 8° mild BOLD eccentricity effect for houses but a reverse BOLD eccentricity effect for faces and no modulation for inverted faces). Our results emphasize that peripheral vision investigations are critical to further our understanding of visual processing.

A new way of classifying developmental prosopagnosia: Balanced Integration Score.

Despite severe everyday problems recognising faces, some individuals with developmental prosopagnosia (DP) can achieve typical accuracy scores on laboratory face recognition tests. To address this, studies sometimes also examine response times (RTs), which tend to be longer in DPs relative to control participants. In the present study, 24 potential (according to self-report) DPs and 110 age-matched controls completed the Cambridge Face and Bicycle Memory Tests, old new faces task, and a famous faces test. We used accuracy and the Balanced Integration Score (BIS), a measure that adjusts accuracy for RTs, to classify our sample at the group and individual levels. Subjective face recognition ability was assessed using the PI20 questionnaire and semi structured interviews. Fifteen DPs showed a major impairment using BIS compared with only five using accuracy alone. Logistic regression showed that a model incorporating the BIS measures was the most sensitive for classifying DP and showed highest area under the curve (AUC). Furthermore, larger between-group effect sizes were observed for a derived global (averaged) memory measure calculated using BIS versus accuracy alone. BIS is thus an extremely sensitive novel measure for attenuating speed-accuracy trade-offs that can otherwise mask impairment measured only by accuracy in DP.

Induced awareness of synesthetic sensations in synesthetically predisposed "Borderline Non-synesthetes".

A long-standing issue concerning synesthesia is whether the trait is continuous or discontinuous with ordinary perception. Here, we found that a substantial proportion of non-synesthetes (>10 % out of >200 unselected participants) spontaneously became aware of their synesthesia by participating in an online survey that forced them to select colors for stimuli that evoke color sensations in synesthetes. Notably, the test-retest consistencies of color sensation in these non-synesthetes were comparable to those in self-claimed synesthetes, revealing their strong though latent synesthetic dispositions. The effect was absent or weak in a matched control survey that did not include the color-picking test. Therefore, the color-picking task likely provided the predisposed "borderline non-synesthetes" with an opportunity to dwell on their tendency toward synesthesia and allowed their subconscious sensations to become conscious ones. The finding suggests that the general population has a continuum of synesthetic disposition that encompasses both synesthetes and non-synesthetes.

Multiple mechanisms of visual prediction as revealed by the timecourse of scene-object facilitation.

Not only semantic, but also recently learned arbitrary associations have the potential to facilitate visual processing in everyday life-for example, knowledge of a (moveable) object's location at a specific time may facilitate visual processing of that object. In our prior work, we showed that previewing a scene can facilitate processing of recently associated objects at the level of visual analysis (Smith and Federmeier in Journal of Cognitive Neuroscience, 32(5):783-803, 2020). In the current study, we assess how rapidly this facilitation unfolds by manipulating scene preview duration. We then compare our results to studies using well-learned object-scene associations in a first-pass assessment of whether systems consolidation might speed up high-level visual prediction. In two ERP experiments (N = 60), we had participants study categorically organized novel object-scene pairs in an explicit paired associate learning task. At test, we varied contextual pre-exposure duration, both between (200 vs. 2500 ms) and within subjects (0-2500 ms). We examined the N300, an event-related potential component linked to high-level visual processing of objects and scenes and found that N300 effects of scene congruity increase with longer scene previews, up to approximately 1-2 s. Similar results were obtained for response times and in a separate component-neutral ERP analysis of visual template matching. Our findings contrast with prior evidence that scenes can rapidly facilitate visual processing of commonly associated objects. This raises the possibility that systems consolidation might mediate different kinds of predictive processing with different temporal profiles.

Visual Perception Principles in Constellation Creation.

Many cultures share common constellations and common narratives about the stars in the night sky. Previous research has shown that this overlap in asterisms, minimal star groupings inside constellations, is clearly present across 27 distinct culture groups and can be explained in part by properties of individual stars (brightness) and properties of pairs of stars (proximity) (Kemp, Hamacher, Little, & Cropper, 2022). The same work, however, found no evidence that properties of triples (angle) and quadruples (good continuation) predicted constellation formation. We developed a behavioral experiment to explore how individuals form constellations under conditions that reduce cultural learning. We found that participants independently selected and connected similar stars, and that their responses were predicted by two properties of triples (angle and even spacing) in addition to the properties of brightness and proximity supported by previous work. Our findings lend further evidence to the theory that commonality of constellations across cultures is not a result of shared human history but rather stems from shared human nature.

From vision to memory: How scene-sensitive regions support episodic memory formation during child development.

Previous brain imaging studies have identified three brain regions that selectively respond to visual scenes, the parahippocampal place area (PPA), the occipital place area (OPA), and the retrosplenial cortex (RSC). There is growing evidence that these visual scene-sensitive regions process different types of scene information and may have different developmental timelines in supporting scene perception. How these scene-sensitive regions support memory functions during child development is largely unknown. We investigated PPA, OPA and RSC activations associated with episodic memory formation in childhood (5-7 years of age) and young adulthood, using a subsequent scene memory paradigm and a functional localizer for scenes. PPA, OPA, and RSC subsequent memory activation and functional connectivity differed between children and adults. Subsequent memory effects were found in activations of all three scene regions in adults. In children, however, robust subsequent memory effects were only found in the PPA. Functional connectivity during successful encoding was significant among the three regions in adults, but not in children. PPA subsequently memory activations and PPA-RSC subsequent memory functional connectivity correlated with accuracy in adults, but not children. These age-related differences add new evidence linking protracted development of the scene-sensitive regions to the protracted development of episodic memory.

The anterior fusiform gyrus: The ghost in the cortical face machine.

Face-selective regions in the human ventral occipito-temporal cortex (VOTC) have been defined for decades mainly with functional magnetic resonance imaging. This face-selective VOTC network is traditionally divided in a posterior 'core' system thought to subtend face perception, and regions of the anterior temporal lobe as a semantic memory component of an extended general system. In between these two putative systems lies the anterior fusiform gyrus and surrounding sulci, affected by magnetic susceptibility artifacts. Here we suggest that this methodological gap overlaps with and contributes to a conceptual gap between (visual) perception and semantic memory for faces. Filling this gap with intracerebral recordings and direct electrical stimulation reveals robust face-selectivity in the anterior fusiform gyrus and a crucial role of this region, especially in the right hemisphere, in identity recognition for both familiar and unfamiliar faces. Based on these observations, we propose an integrated theoretical framework for human face (identity) recognition according to which face-selective regions in the anterior fusiform gyrus join the dots between posterior and anterior cortical face memories.